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\ Boltzmann's principle S = k\nW \s generalized to non-equilibrium Hamiltonian 

■ systems with possibly fractal distributions in phase space by the box-counting vol- 

^ ' ume. The probabilities P{M) of macroscopic observables M are given by the ratio 

Q , P{M) = W{M)/W of these volumes of the sub-manifold M of the microcanon- 

•"7" ■ ical ensemble with the constraint M to the one without. With this extension of 

' the phase-space integral the Second Law is derived without invoking the thermo- 

00 , dynamic limit. The irreversibility in this approach is due to the replacement of the 
phase space volume of the possibly fractal sub-manifold A4 by the volume of its 

(— I I closure M. In contrast to conventional coarse graining the box-counting volume is 

. defined by the limit of infinite resolution. 
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^ ; I. INTRODUCTION 



Einstein considers Boltzmann's definition of entropy as e.g. written on his famous epitaph 



S=k-lnW 



(1) 



a 

a _ 

^ , as the fundamental microscopic definition of entropy, Boltzmann's principle, Here W is the 
I I number of micro-states at given energy E of the iV-body system in the spatial volume V: 

W{E,N,V)^tr[eoSiE-HN)] (2) 



eo is a suitable energy constant to make W dimensionless, and Hjsi is the A''-particle Hamilton- 
function. In what follows, we remain on the level of classical mechanics. The only reminders 
of the underlying quantum mechanics are the measure of the phase space in units of 27r?i and 
the factor 1/7V! which respects the indistinguishability of the particles (Gibbs paradoxon). In 
"j^ ' contrast to Boltzmann who used the principle only for diluted gases and to Schrodinger |Q, 
who thought equation (|l|) is useless otherwise, I take the principle as the fundamental, generic 
I definition of entropy. In a recent book |^ cf. also I demonstrated that this definition of 
' O thermo-statistics works well especially also at higher densities and at phase transitions without 
g ■ invoking the thermodynamic limit. 

^ I After succeeding to deduce all phenomena of phase transitions from Boltzmann's principle even 
|L* ' for "Small" , i.e. non-extensive many-body systems, it is challenging to explore how far this 
.{^ "most conservative and restrictive way to Thermodynamics" |^ is able to describe also (even- 
tually "Small") systems approaching equilibrium and the Second Law of Thermodynamics. In the 
^ following such an attempt is undertaken. 
■ - - Thermodynamics describes the development of macroscopic features of many-body systems with- 

out specifying them microscopically to all details. Before we address the Second Law, we have to 
clarify what we mean with the label "macroscopic observable" . 

II. MEASURING A MACROSCOPIC OBSERVABLE 

A single point {qi{t),pi{t)}i=i...N in the iV-body phase space corresponds to a detailed micro- 
scopic specification of the system with all degrees of freedom (d.o.f.) completely fixed at time t 
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(microscopic determination). Fixing only the total energy E of an iV-body system leaves the other 
(6A^ — l)-degrees of freedom unspecified. A second system with the same energy is most likely not 
in the same microscopic state as the first, it will be at another point in phase space, the other 

d. o.f will be different. I.e. the measurement of energy H, or any other macroscopic observable M, 
determines a submanifold £ or M in phase space. All points in phase space which are consistent 
with the given value of E, i.e. all points in the (6A^ — l)-dimensional submanifold £ of the phase 
space are equally consistent with this measurement. £{N, V) is the micro-canonical ensemble. 
This example tells us that any macroscopic measurement defines a smaller or greater submanifold 
of points in phase space. An additional measurement of any other macroscopic quantity B{q,p} 
reduces £ further to the cross-section £ n B, a subset of points in £ with the volume: 

WiB,E,N,V)^^J (^^^0^ eoSiE-Hr,{q,p})SiB^B{'l,P}) (4) 

If HN{q,p} as also B{q^p} are continuous differentiable functions of their arguments, what we 
assume in the following, £ B is closed. 

Microcanonical theimo statics gives the probability P{B, E, N, V) of the A^-body system, speci- 
fied only by the prescribed energy E, to be found in the submanifold B{E, N, V) C £{N, V): 

P(B E N V)^ W{B,E,N, V) ^ in{w{B,EM,v))~s{E,Ny) (^-^ 
^ ' ' ' ^ W{E,N,V) ^ ' 

This is what Krylov seemed to have in mind ^ . 

Similarly thermodynamics describes the development of some macroscopic observables i3{(j't,P(}, 
i.e. the probability P(B(t)) of the system to be at time t in the submanifold B(t) after it was 
specified by another macroscopic observable A{go,Po} at the earher time t^. It is related to the 
volume of the submanifold M{t) = A{tn) nB{t)r\£: 

W{A, B,E,t)^^l {^^^^ S{B - B{qt,pt}) S{A - i{go,Po}) e,S{E - H{qt,Pt}), (6) 

where {qt{qo,Po},Pt{qo,Po}} is the set of trajectories solving the Hamilton- Jacobi equations 

dH . dH 

OPi oqi 

with the initial conditions {q{t — to) — qo; p{t — to) — Po}- 

For a very large system with N ~ 10^^ the probability P{B{t)) is usually sharply peaked as 
function of B. Ordinary thermodynamics treats systems in the thermodynamic limit N ^ oo and 
gives only <B(t)>. However, here we are interested in a general application eventually also to 
small systems i.e. we are interested in the whole distribution P(B{t)) not only in its mean value 
<B{t)>. Thermodynamics does not describe the temporal development of a single system (single 
point in the 6A^-dim phase space). 

There is an important property of macroscopic measurements: Whereas the macroscopic con- 
straint ^{^0,^0} determines (usually) a compact region A(to) in its arguments this does not need 
to be the case for A{t) given by A{qo{qt, pt} , Po{qt, Pt}} as function of {qt,Pt} at time t ^ to. It is 
likely that A{t) is a fractal (e.g. spaghetti-like) submanifold of {qt,Pt} in £■ I-e. there are series of 
points a„ G A{t) which converge to a point Ooo not in A(t). E.g. such points may have intruded 
frome outside. Nice examples for this evolution to fractal distributions in phase space are given 

e. g. by ref. ^d^. Then no macroscopic (incomplete) measurement at time t can resolve Ooo 
from its immediate neighbors a„ in phase space with distancees |a„ — Oool less than any arbitrary 
small S. In other words, at the time t ^ to no macroscopic measurement with its incomplete 
information about {qt,Pt} can decide whether qo{qt,Pt},Po{qt,Pt} £ -^(^o) or not. If necessary, 
the submanifold determined by a macroscopic theory like thermodynamics must be the artificially 
closed Ai{t). Clearly, this is the origin of irreversibility. We come back to this in the next section. 
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III. FRACTAL DISTRIBUTIONS IN PHASE SPACE, SECOND LAW 



Here we will first describe a siniple working-scheme (i.e. a sufficient method) which allows to 
deduce mathematically the Second Law. Later, we will show how this method is necessarily implied 
by the reduced information obtainable by macroscopic measurements. 

Let us examine the following Gedanken experiment: Suppose the probability to find our system 
at points {o'tjPt}]^ in phase space is uniformly distributed for times t < to over the submanifold 
£{N, Vi) of the A^-body phase space at energy E and spatial volume Vi. At time to we allow the 
system to spread over the larger volume V2 > Vi without changing its energy. If the system is 
dynamically mixing, i.e.: the majority of trajectories {qt,Pt}'i in phase space starting from points 
{qqtPq} with qq C Vi at to will now spread over the larger volume V2. Of course the Liouvillean 
measure of the distribution M{qt,Pt} in phase space att > to will remain the same (= tr[£{N, Vi)]) 
0: 



. , , , , f 1 f (Pqt (Pp; 

tr[M{qt{qo,Po),Pt[qa,Po)}\\[q„cVi} = / ttt %y 



N 



{goCVi} 



1 

TV! 



N 



because of: f j^'^''^*^ — 1. 
a{qo,Po\ 



eoS{E - HN{qt,Pt}) 
eo5{E ~ HN{qo,po}), (8) 

(9) 



But as already argued by Boltzmann the distribution Ai{qt,Pt} will be filamented like ink in water 
and will approach any point of £{N,V2) arbitrarily close. Al{gt,Pt} becomes dense in the new, 
larger £(7V, V2) for times sufficiently larger than to- The closure M becomes equal to £{N,V2)- 
This is clearly expressed by Lebowitz . 

In order to express this fact mathematically, we have to redefine Boltzmann's definition of entropy 
eq.^ and introduce the following fractal "measure" for integrals like or 



M{E,N,t:$>to) = 



With the transformation: 



iV! 



{d'qt d^Pt) 



N 



{qo{qt,pt}cVi} 



dai ■ ■ ■ da, 



d^qt d^pt 
(27r?i)3 



N 



eoS{E - HN{qf,Pf}) 



dfJQisi :— 



\NH\\ 
M{E,N,t:^ to) 










/ dH 


dqi 4 


dH 


\dqt 


OPi 




E 


^ dH 
[dp. 



NH\ 



-dE 



we replace M hy M and define now: 

M{E,N,t:^to) -^<G{£{N,V2)> *voW[X(S, iV, t » to)], 



(10) 

(11) 
(12) 

(13) 
(14) 

(15) 



where < G{£{N,V2)) > is the average of 



over the (larger) manifold £{N,V2), 



7V!(27r;i)3"||VH| 

the closure of Ai{E,N,t ^ to), and vo\box[M{E, N,t ^ to)] is the box-counting volume of 
MiE,N,t:^to). 

To obtain volbox[.M{E, N,t ^ to)] we cover the d-dim. submanifold Ai{t), here with d = 
{6N — 1), of the phase space by a grid with spacing S and count the number Ns oc S^'^ of boxes, 
of size S^^ , which contain points of A4 . Then we determine 
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volboAM{E,N,t:^ to)] ■.= \jms^„S''Ns[M{E,N,t:^ to)] (16) 
with lim * = inf[lim*] or symbolically: 



J_ f f (fqt (Pp. 

m 



JiqtCV2} \ (27r?i)3 J 



W{E, N, V2) > W{E, N, Vi), (18) 



where means that this integral should be evaluated via the box-counting volume here with 
d^6N -I. 

With this extension of eq.(||) Boltzmann's entropy (|l|) is at time t ^ to equal to the logarithm 
of the larger phase space W{E, N, V2). This is the Second Law of Thermodynamics. 
Of course stiU at to M{to) ^ M{to) ^ £{N,Vi): 

M{E,N,to)=--lf^ ij(^-^^Y ^oSiE-H^) (19) 

N 



= W{E,N,Vi). (20) 

The box-counting volume is analogous to the standard method to determine the fractal dimension 
of a set of points jl^ by the box-counting dimension which is itself closely related to the Kolmogorov 
entropy 0,|l|: 

^irn,.AMiE,N,t»to)] ^MiE^N.t » to)] ^^^^ 

Like the box-counting dimension, volf,oa; has the peculiarity that it is equal to the volume of 
the smallest closed covering set. E.g.: The box-counting volume of the set of rational numbers 
{Q} between and 1, is vol;,ox{Q} = 1, and thus equal to the measure of the real numbers , 
c.f. Falconer section 3.1. This is the reason why volfcoa; is not a measure in its mathematical 
definition because then we should have 



«C{Q} 



E voW[A^»] =0, (22) 

»C{Q} 



therefore the quotation marks for the box-counting "measure" . 

Coming back to the the end of the previous section, the volume W{A, B, - ■ ■ ,t) of the relevant 
ensemble, the closure Ai{t) must be "measured" by something like the box-counting "measure" 

( p!6| , p7| ) with the box-counting integral 1^^ which must replace the integral in eq. . 



IV. CONCLUSION 

Macroscopic measurements M determine only a very few of all 6iV d.o.f. Any macroscopic theory 
like thermodynamics deals with the volumes of the corresponding submanifolds A4 in the 6iV-dim. 
phase space not with single points. This fact becomes especially clear for the microcanonical ensem- 
ble of a finite system. Because of this necessarily coarsed information macroscopic measurements, 
and with it also macroscopic theories are unable to distinguish fractal sets A4 from their closures 
M. Therefore, the proper manifolds determined by a macroscopic theory like thermodynamics 
are the closed A^. However, an initially closed subset of points at time to does not necessarily 
evolve again into a closed subset at t > to- I-e. the closure operation does not commute with the 
dynamics of a set of points in phase space, and the macroscopic dynamics becomes irreversible. 
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The use of the box-counting volume l^d in Boltzmann's principle (eqj^ together with eq.|^) al- 
lows to derive the Second Law without invoking the thermodynamic limit N oo. We must 
only demand that N ^ than the small number of explicit macroscopic d.o.f. 3), the control 
parameters. This is in contrast to Lebowitz fl^ ]. Also no finite coarse graining is needed. The 

resolution 6 can be chosen arbitrarily small. The prize to be paid is that ]jd is not a measure, see 

above. Evidently, due to this replacement of 7W by or the integral over phase space, eq.(^, by 
its box-counting variant, eq.(^7|), the irreversibility and the increase of entropy comes about in our 
formalism. 

Thanks to A.Ecker for mathematical advices. 
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